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FOREIGN LANGUAGE PROFICIENCY TESTS OF THE MODERN 
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IMPROVEMENT ACHIEVED BY 2,300 FOREIGN LANGUAGE TEACHERS WHO 
RECEIVED ADVANCED TRAINING IN THE 1966 NDEA SUMMER FOREIGN 
language INSTITUTES. TEACHERS C»F FRENCH, GERMAN, ITALIAN, 
RUSSIAN, AND SPANISH IN 52 INSTITUTES WERE TESTED AT THE 
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IN WHICH INSTRUCTION WAS OFFERED— LISTENING COMPREHENSION, 
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THE 1966 NDEA SUMMER FOREIGN LANGUAGE INSTITUTES 
PRETEST AND H)STTEST RESULTS 

For the past several years the United States Office of Education, under 
the provisions of the National Defense Education Act, has sponsored institutes 
for teachers of foreign languages. In the summer of I966 these institutes were 
again held in colleges and universities across the country. Approximately 2,300 
participants attended institutes at fifty-two centers for the study of one of the 
five languages offered. Twenty-three of the institutes offered instruction in 
French, eight in Gexman, two in Italian, two in Russian, and seventeen in Spanish. 

In most of the institutes tests of language skills were administered to 
participants at the beginning and again at the end of the program of instruction. 
This report is concerned with the change of scores obtained by participants from 
pretest to posttest. The scores of 776 teachers of French at nineteen institutes, 
187 teachers of German at five institutes, 64 teachers of Italian at two insti- 
tutes, 77 teachers of Russian at two institutes, and 654 teachers of Spanish at 
fifteen institutes are included in this analysis. 

Description of the Tests 

The tests used in this program were the MIA Foreign Language Proficiency 
Tests for Teachers and Advanced Students. There were seven tests for each of the 
five languages, four in the basic skills and three in related areas: 

Basic Skills: Listening Comprehension (36 items) 

Speaking (105 scorable units) 

Reading (50 items) 

Writing (60 items) 

Related Areas: Applied Linguistics (55 items) 

Civilization and Culture (60 items) 

Professional Preparation (65 items) 

(common to all languages) 

The Listening Comprehension Tests were presented on master tapes through earphones 
or speakers, and the examinees recorded their responses on answer sheets. The 
Speaking Tests were presented in a similar way, but the examinees recorded their 
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responses on tape. The Writing Tests included a section of completion exercises 
and an interlinear section. Both the Speaking and Writing Tests were graded by 
(i professional staff of language specialists^ but the others were multiple—choice 
tests and machine scorable. 



Scaled Score System 

Two forms of the MIA Foreign Language Proficiency Tests were used in 
this administration, OMLl for the pretesting and 0ML2 for the posttesting. These 
two foms are reprints of earlier forms with a change in format to facilitate 
handling and processing. Form OMLl is a reprint of Form K-JML2, except for the 
Italian tests in the four skills. Applied Linguistics, and Civilization and 
Culture, which are Form K-JMLl. Form 0ML2 is a reprint of Form NML, except for 
the same Italian tests, which are Form K-JML2. 

In the original scaling of the MIA Proficiency Tests in the I 96 I NDEA 
Foreign Language Summer Institutes, each test in the K-JMLl (Form A) series was 
scaled simply by adding 20 points to the raw score. The purpose of adding the 
20 points was to avoid negative scores when future forms were equated back to 
this base form. Two alternate forms of the tests have been introduced and equa- 
ted to the K-JMU seriesi K-JML2 (Form B) in the 1961 NDEA Summer Institutes and 
NML (Form C) in the I 965 NDEA Summer Institutes. The details of the equating 
procedure were discussed in the statistical gain report for the I 965 NDEA Summer 
Foreign Language Institutes. 

The scaled score ranges for the two forms used in this administration 
are listed in Table 1. It should be noted that the kind of scaling and equating 
used for the MIA Proficiency Tests permits comparisons only between scaled scores 
for a given test in a given language. 

Pre- and Posttest Results 

The results of the pre- and posttesting for the 1966 NDEA Summer Insti- 
tutes are presented in six tables. Each set of statistics is based on the per- 
formance of persons for whom both pretest and post test scores were available. 
Tables 2-6 present the results for French, German, Italian, Russian, and Spanish, 
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respectively, separately by institute and by test within each institute. Each 
set of statistics includes the pretest mean and standard deviation! post test 

mean and standard deviation, the number of persons in that institute who have 
both pre- and posttest scores on that test, the number in that group whose, pre- 
test scores were higher than their posttest scores, the number in that group 
whose posttest scores were higher than their pretest scores, and the per cent 
of persons showing a gain. Table 7 presents the same kinds of infoiroation for 
each language group, and for the Professional Preparation Tests for all groups 
combined. 



The difference between the pretest mean and the posttest mean for each 
group included in Tables 2-7 was tested for significance by use of a correlated 
t test. Since gains were expected from pretest to posttest, a single-sided test 
of significance was used. Posttest means that were significantly greater than 
the corresponding pretest means at or beyond the .05 or .01 levels are identi- 
fied in the tables by one and two asterisks, respectively. Thus a significant 
difference is defined as one which is likely to occur by chance no more than five 
per cent of the time. 



Comparisons among Tests and among Institutes 

Several different kinds of comparisons can be made on the basis of 
the results of this study. Here attention will be focused on three of these: 

(1) differences in the amount of gain among the tests for a given language, 

(2) differences in the amount of gain among the institutes for a given test in 
a given language, and (3) for the Professional Preparation Test differences in 

^ the amount of gain among the institutes and across languages. The results 

presented in Table 7 will be used as the basis for comparisons among the tests. 
Tables 2—7 will be used for the other comparisons. 

Comparisons among Teats 

Although the methods used for the scaling and equating of the MIA 
Proficiency Tests do not permit comparisons of the amount of gain among tests 
when that gain is ejq>ressed in terms of scaled score units, such comparisons 
are possible when two conditions are miet: when the gain is e^q)ressed as a pro- 
portion of the standard deviation, and when the means for the different tests 
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are based on the same group of students.' In^^Table 7 the difference between the 
total group pre— and posttest means and that difference expressed as a propor- 
tion of the pretest standard deviation are reported for each test. Although the 
number of persons taking both a pre- and a posttest varies from test to test, 
there is a considerable amount of overlap in all cases, except Russian. In the 
case of Russian, both of the participating institutes administered the pre— and 
posttests in the four skills, but only one of them did this for the three non- 
skills tests. 



Of the French tests, the greatest amount of relative gain is shown in 
the Applied Linguistics and Professional Preparation Tests (0.84 and 0.79 of a 
standard deviation, respectively), while the lowest relative gain is shown in 
the Reading Test (O.4O) and the Listening Comprehension Test (O.46). The gains 
for the remaining three tests are similar to each other and about midway between 
the two high and the two low gains: 0.54 for the Writing Test, 0.57 for the 
Speaking Test, and 0.62 for the Civilization and Culture Test. The order of 
mean relative gains is similar to the pattern reported for the I965 NDEA Insti- 
tutes, with one notable exception. The gain for the Writing Test has increased 
from the 1965 low of 0.29 to the I966 middle value of 0.54* It is also inter- 
esting to note the similarity between corresponding means for the I965 and I966 
French institutes. The greatest differences are in the means for the Writing 
Test, with the 1966 pretest mean lower than the 1965 mean and the posttest mean 
higher, as is reflected in the higher relative gain (0.54 as compared to 0.29). 

For German, the greatest amount of relative gain is shown in the 
Professional Preparation Test (0.93) and the Applied Linguistics Test (0.79). 
Relative gains in the middle range are shown* on the Civilization and Culture 
Test (0.54) and the Writing Test (0.53)^ while the relative gains on the other 
skills tests are quite low: 0.37 for Listening Comprehension, 0.13 for Speaking, 

and 0.12 for Reading. There has been a marked change in the order and order of 
magnitude of the mean relative gains from 1965 to I966 for the German institutes. 
The gain for Professional Preparation increased from 0.54 to 0.93, and that for 
Writing increased from 0.25 to 0.53* In contrast to these, the gain for Reading 
dropped from 0.27 to 0.12, and that for Speaking from 0.59 to O.I3. It may be 
relevant to note that, although the posttest means for I966 differ by less than 
.8 from the corresponding 1965 means, three of the pretest means are quite 









-5- 



different from the 1965 values. For Professional Preparation the pretest mean 
decreased from 63. 07 to 59.90, for Writing the decrease was from 53.31 to 49.38, 
and for Speaking the pretest mean increased from 86. 4I to 92.47. An unusually 
high proportion of students encountered problems with the tape or recording 
equipment (24 out of 182). 

The results for Italian are based on the performance of sixty-four 
students in two institutes, with all students taking all tests. The most notable 
amount of relative gain for this group is that for Professional Preparation: 

1*05, which is the highest for all language groups on this common test. In con- 
trast to this is the "gain" for the Listening Comprehension Test: -0.08, which 

corresponds to the -0.01 value for 1965 . The relative gains for the other tests 
' lie between these two extremes and may be classed in three groups: Writing, 

with a low gain of O.I3 indicating an increase in mean that is barely signifi- 
cant at the .05 level; Reading, with a moderate gain of 0.44j sJ^d the three 
remaining tests with relatively high gains, 0.62 for Applied Linguistics, 0.67 
for Civilization and Culture, and 0.74 for Speaking. Because the 1965 total 
group for Italian consisted of only twenty-five students in one institute, com- 
parisons between the two years may not be meaningful. It does seem, however, that 
the Italian institutes tend to stress professional preparation and to give very 
little emphasis to listening comprehension. 

There were only two Russian institutes, and only one of these adminis- 
tered the c^plete battery of tests. For this reason, caparison of the amounts 
of relative gain must be made separately among the four skills tests and the 
three non-skills tests. The amount of gain for the Listening Ccmiprehension Test 
is low and barely significant at the .05 level. The three other skills tests 
have moderate gains in the 0.46-0.52 range. Among the non-skills tests the 
highest relative gains are reported for Civilization and Culture (0.99) and 
Applied Linguistics (0.89), while the gain for Professional Preparation is 
moderate (O.4I). Because both the 1965 and I966 groups are very small, compari- 
sons between them are not meaningful, except, perhaps, for the Speaking Test. 

Both of the I966 means for the Speaking Test are nearly one standard deviation 
higher than the corresponding 1965 means. 
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For Spanish, the greatest relative gain is reported for the Speaking 
Test, a gain of I.48 as compared with the 1965 high gain of 1.15. The next 
highest relative gains are shown for Applied Linguistics (0.95) and Professional 
Preparation (0.86). Moderate relative gains ranging from 0.39 to 0.59 are shown 

for the other tests. The order of relative gain for I966 follows the same general 
pattern as that for 1965 . 



In summary of the comparisons of gains among tests, it can be stated 
that applied linguistics and professional preparation were emphasized the most 

in the 1966 NDEA institutes, while two of the skills, listening comprehension and 
reading, were least emphasized. 



Compariso ns among Institutes for a Specific Language 

A reasonable comparison among institutes can be made by establishing 
a rank order for each test based on the mean gains and the range of mean gains. 
Since the comparisons are made among mean gains on a single test, there is no 
need to express the gains in terms of the pretest standard deviation. Because 
the numbers of Institutes for French and for Spanish are rather large, only the 
five top-ranking institutes and the one or two lowest-ranking institutes vrill be 
noted. All institutes in the first group had gains that were significant at the 
.01 level; for those in the low group the level of significance is indicated 
after the institute number, two asterisks indicating a gain significant at the 
t level, one asterisk at the .05 level, and no asterisk, no significant gain. 

For German, Italian, and Russian, all institutes will be included in the rank 
order list with an indication of the level of signifi^nce of the gain. 

French (I9 institutes) ; For esich of the seven Proficiency Tests, 
the five institutes showing the largest gains and the one or two showing the 
smallest gains are listed below, the first group in rank order from largest gain 
to smallest, and the second group in the opposite order. The largest and the 
smallest gains are given in parentheses. 

Listening Comprehension 

Largest gain (6. 59): 2971,1497,5010,4389,3916 
Smallest gain (0.51)! 5110, l63HHf, 6875* 
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Speaking 



Largest gain 
Smallest gain 



Reading 



(12.74) s 4389, 2971, 2226, 5010, 5110 
(-0.34): ‘ ' 



3901, 1631, 926 



Largest gain (5.36): 3916, 2226, 5110, 6875, 5887 
Smallest gain (2.3I): 2971^^^ 

Writing 

Largest gain (8.72): 5110, 2395, 887, 4389 and 5887 

Smallest gain (4.09): 2226^^$- 

Applied Linguistics 

Largest gain (9.58): 5010, 3898, 2226, 887, 6875 

Smallest gain (1.22): 2562 

CivrLlization and Culture 



j 



\ 









Largest gain (9.79): 5887, 4389, 2971, 5010, 3390 

Smallest gain (0.86): 2395, 3898, 2562 

Professional Preparation 



Largest gain (9.14): 5010, 5887, 3916, 6875, I63I 

Smallest gain (2.35): 5904^^ 2562^^ 

It can be noted that all but four of the French institutes rank 
among the top five for at least one test, and that some institutes are listed 

among the top five for more than one test. Institute 5010, for example, is 

» « 

so listed for five tests. Of those institutes listed for the smallest gains, 
all but two had pretest means above the pretest means for the total French 
group on the test in question. Although Institute 2562 is listed among the 
low groups for all three tests taken at that institute, it has pretest means 
about one standard deviation above the means for the total French group. 

German (5 institutes) : Of the five participating German insti- 

tutes, only four have scores on the four skills tests. The institutes are 
listed in rank order for each test, from highest gain to lowest, and the range 
of mean gains is given in parentheses. 



Listening Comprehension (5.85 to 1.02) 



48595W^ 44885h^, 2672^«^ 2929 
Sneaking (4*02 to -0.92) 

44885Hf, 48595^ 2672^^ 2929 
Reading (2.32 to 0.50) 

2929^«S 44885^ 4859, 2672 
Writing (10.51 to 4.70) 

48593Hf, 44885W, 2672 ^«^ 29295 «^ 

Applied Linguistics (10.63 to 3.72) 

4859«Hf, 44885HS 2562, 2929^«5-, 2672^«^ 

Civilization and Culture (6.14 to 4.79) 

4859^^^ 2672^H^ 2562 and 2929^«^ 2672^«^ 

Professional Preparation (13.68 to 2.34) 

4859^«^ 29295W, 4488^H5-, 2562, 2672«w 

The outstanding performance among the German institutes was by 
institute 4859, which not only had pretest means above the pretest means for 
the total German group, but ranked first in gain on five of the tests. It is 
interesting to note that speaking was not stressed among the German institutes, 
only one of which showed a significant gain at the .01 level. It should be 
noted that the gains for Institute 2562 are based on only five cases, and the 
significance tests for such small groups are not very meaningful. 

Italian (2 institutes) ; Of the two Italian institutes, 2765 
had larger gains on all tests but Listening Comprehension, and neither insti- 
tute showed a gain on that test. The gains are listed below with the institute 
2765 gains first and 3898 second. 

Listening Comprehension ; -0.75 and 0.04 
Speaking t 15.56^^^5- and 6.20?^^ 

Reading : and 4.085H5- 
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Writing t 1.95'^5- and 1.16 
Applied Linguistics : 5«66^M5- and 3.96 ^hs- 

Civilization and Culture : 6.23-55^f- and 3.8dJH5- 

Professional Preparation : 11.23-5H5- and 2.88JH5- 

Russian (2 institutes) : Of the two Russian institutes, 1324 and 
3351, only the latter took the complete battery of tests, and therefore they 
can be compared on only the skills tests. The mean gains are listed below with 
those for Institute 1324 first. 

listening Comprehension : -O.4I and 2.U-5H5- 

Speaking : 1.55 and C.OO^wf- 

Reading : and 

Writing : 5.07^^^ and 7.39^^^ 

Spanish (15 institutes) : The results for the Spanish institutes 

are listed in the same way as those for French, the five showing the largest 
gains listed from high to low, and the ones with the smallest gains listed with 
the smallest first. 



Listening Comprehension 



Largest gain 
Smallest gain 



Speaking 



Largest gain 
Smallest gain 



Reading 



Largest gain 
Smallest gain 

Writing 

Largest gain 
Smallest gain 

Applied Linguistics 

Largest gain 
Smallest gain 



( 5.66): 1834, 1494, 5904, 1372, 
( 1.56): 1324-5'* 



(27.03): 2295, 5816, 5904, 6101, 2805 
( 5.77): 1324^«5- 



( 5.29): 6101, 5904, 2805, 1372, 4492 
( 1.33): 1324^^ 



(10.16): 3390, 2270, 5904, 4852, 2805 
( 2.30): 1372^^^ 



( 9.93): 6101, 1834, 2295, 1494, 1372 
( 4.14): 1324^”^ 
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Civilization and Culture 

Largest gain (10.06): 6101, 4492, 968, 1372, 2805 

Smallest gain ( 2.00): 1834-}(^^ 

Professional Preparation 

Largest gain ( 9.15): 4492, 6101, 5222, 1834, 1372 
Smallest gain ( 2.70): 1324^«^ 3390«w 

Every Spanish institute ranked among the top five on at least one 
test, and one of them, 6101, ranked among the top five on six tests. Every 
Spanish institute showed a gain significant at at least the .05 level on every 
test, and all but two of the gains were significant at the .01 level. Insti- 
tute 1324 seems at first glance to make a relatively poor showing, but two 
points should be noted here: all of the gains for this institute were significant, 
and all of the pretest means for this institute were higher than the post test 
means for the total Spanish group, with three of these differences equal to more 
than one standard deviation. Another interesting fact is that the gains on the 
Speaking Test for all institutes but one are more than one pretest standard 
deviation (13.28) for the total group, and for the top-ranking institute more 
than two standard deviations. 

The above comparison among institutes in the language groups empha- 
sizes the variation among the institutes showing large and small gains on the 
seven tests. A principle of compensation seems to be operating, with each 
institute stressing certain aspects of the language at the expense of the 
others. In general, the non-skills aspects and writing and speaking received 
the greatest attention. 

Comparison among Institutes across Languages for the Professional 

Preparation Test 

The last comparison to be made is that among all institutes for the 
Professional Preparation Test, the only test in the battery that vras common to 
all languages. The ten institutes with the highest gains and the ten with the 
lowest gains are listed in rank order from high to low: 
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Mean Gain 

High Group: 13.68 

11.23 

9.15 

9.14 

9.08 

8.92 

a.35 

8.22 

8.12 

7.82 

Low Group: 3*70 

3.5a 

3.56 

3.02 

2.88 

2.83 

2.70 

2.60 

2.35 

2.34 



Limitationa 



Institute 


Lanauai^e 


4859 


Gexmn 


2765 


Italian 


4492 


Spanish 


5010 


French 


5887 


French 


3916 


French 


6101 


Spanish 


6875 


French 


5222 


Spanish 


1631 


French 


3390 


French 


4389 


French 


2562 


French 


3351 


Russian 


3898 


Italian 


3390 


Spanish 


1324 


Spanish 


2562 


Gennan 


5904 


French 


2672 


German 


f the Data 





As in previous NDEA statistical reports, it is necessary to point 
out two limitations of the data: the lack of a control group' with which to 
compare gains, and the possible low degree of comparability of scores for 
alternate forms of each test. 



The purpose of having a control group is to rule out any explanation 
of the gains other than the instruction at the institutes. Even though most of 
the differences between the pre- and posttest means were statistically signifi- 
cant, one can not be completely confident that the gains were the result of the 
instruction, because other influences may have been operating. For example, the 
gains may be explained, at least in part, by the practice effect from the pre- 
testing. This explanation is rather unlikely because different forms were used 
for the pre- and posttesting. Another factor that may have contributed to the 
gain is the reaction to the pretesting. Since students probably knew that they 
would be given a posttest, the pretesting itself may have been a stimulus to 
change . 
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Th© s6cond limitation is the possible low degree of comparability, of 
scores between alternate forms of each test. One of the factors that affect 
comparability is equating error. The equating error for most of the tests used 
may be large because the equating samples were of necessity small. Another 
factor that contributed to equating error was the method of establishing equa- 
ting samples for certain of the tests by administering old and new forms to 
complete candidate groups at the institutes without having an anchor test to 
adjust for differences between the groups. Any equating error biases the 
results reported here. Another factor that affects comparability is the 
failure of the score limits to be the same from form to form. One can see, 
for example, in Table 1 the score limits for French Reading are 19 and 69 
for one form and 23 and 81 for the other fom. On this test a very good 
student who scores high on both pre- and post-tests may show a large gain 
due more to the higher limit on the posttest than to a real increase in 
reading proficiency. 

Both the lack of a control group and the possible low degree of com- 
parability between test forms limit the precision of the results reported here. 
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Table 1 

MLA Foreign Language Proficiency Tests 
Converted Score Ranges for Foms OMLl and 0ML2 



Form QMLL 
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Minimum Maximum 



Form (Mi2 



French; 

Listening Comprehension 

Speaking 

Reading 

Writing 

Applied Linguistics 
Civilization and Culture 

German: 

Listening Comprehension 

Speaking 

Reading 

Writing 

Applied Linguistics 
Civilization and Culture 

Italian: 

Listening Comprehension 

Speaking 

Reading 

Writing 

Applied Linguistics 
Civilization and Culture 

Russian: 

Listening Comprehensicxi 

Speaking 

Reading 

Writing 

Applied Linguistics 
Civilization and Culture 

Spanish: 





Listening Comprehension 




Speaking 


§M 


Reading 


9 


Writing 


m 


Applied Linguistics 


1 ' 


Civilization and Culture 



Minimum Maximum 



All Languages: 

Professional Preparation 



20 


58 


16 


57 


17 


128 


25 


119 


19 


69 


23 


81 


18 


77 


23 


88 


17 


76 


18 


82 


19 


79 


17 


77 


16 


58 


6 


58 


8 


138 


0 


141 


23 


70 


16 


70 


18 


77 


24 


83 


20 


75 


17 


78 


20 


83 


11 


77 


20 


56 


20 


53 


20 


125 


15 


129 


20 


70 


12 


73 


20 


80 


22 


83 


20 


75 


22 


76 


20 


80 


22 


83 


24 


57 


27 


51 


30 


123 


35 


121 


20 


71 


14 


71 


25 


. 81 


25 


88 


25 


67 


21 


73 


23 


81 


18 


79 


21 


56 


22 


63 


14 


121 


17 


116 


20 


69 


20 


69 


22 


81 


25 


91 


20 


74 


15 


75 


21 . 


81 


18 


89 


25 


84 ■ 


22 • 


88 



MLA Foralga Luiguafe Pk>ofici«ncy Tot* in FRBICH 
Kmum aiuS StaiMUrd Deviation* for Fr«- and Po*tt**t* and Per Cent Shoidng Gain 



















T.' , % 




V'l 



;-:F' 





V^B 



Institute 


listening . 








Applied 1 


Civilisation 


Professional 


Nuoiber 


Item 


Comprehension 


Speaking 


Reading 


Writing 


linguistic 8 and Culture 


Preparation 


0687 


Rretest Mean 


41.48 


70.60 


42.77 


41.02 


47.61 


43.52 


63.23 




Pretest Standard. Deviation 


8.00 


10.23 


8.53 


10.62 


8.02 


6.29 


7.51 




Posttest Mean 


45.91** 


76.43** 


45.80** 


48.16** 


55.75** 


48.07** 


69.48** 




Posttest Standard Deviation 


7.09 


7.98 


6.34 


10.53 


8.29 


7.38 


5.82 




Number of Cases 


44 


35 


44 


44 


44 


44 


44 




Number with Pretest High 


9 


9 


10 


5 


3 


8 


5 




Nuiber with Posttest High 


33 


26 


3L 


39 


40 


33 






Per Cent Showing Gain 


75 J * 


749< 


70% 


899( 


9198 


7598 


8998 


0962 


Pretest Mean 


40.56 


71.22 


43.35 


41.65 


47.15 


44.43 


62.91 




Pretest Standard Deviation 


6.16 


5.55 


6.70 


9.62 


7.40 


6.64 


6.56 




Posttest Mean 


44.67*** 


72.20 


46.31** 


48 . a ** 


51.48** 


48.00** 


69.93** 




Posttest Standard Deviation 


6.13 


6.70 


7.83 


9.70 


7.76 


6 . a 


6.01 




Number of Cases 


46 


40 


46 


48 


46 


46 


46 




Number with Pretest High 


7 


16 


13 


4 


11 


6 


0 




Number wl*th Poettest High 


35 


21 


33 


43 


34 


32 


44 




Per Cent Showing Gain 


73% 


529( 


699 J 


9098 


7498 


7098 


9698 


1497 


nwtSESt Mean 


33.74 


58.30 


37.49 


33.98 


40.77 


39.09 


59.96 




Pretest Standard Deviation 


4.97 


10.25 


7.62 


10.13 


7.08 


6.51 


6.23 




Posttest Mean 


39.30** 


67.61** 


41.60** 


39.64** 


45.66** 


43.02** 


65.06** 




Posttest Standard Deviation 


7.50 


6.30 


6.56 


9.32 


7.06 


6.66 


7.60 




Number of Cases 


46 


46 


47 


47 


47 


47 


47 




Nuiber with Pretest High 


6 


5 


9 


5 


8 


11 


6 




Number with Posttest High 


38 


39 


36 


41 


36 


32 


38 




Per Cent Showing Gain 


839^ 


859^ 


77% 


8798 


7798 


6898 


6198 


1631 


Pretest Mean 


49.29 


80.71 


52.55 


52.71 


50.55 


49.94 


65.20 




Pretest Standard Deviation 


5.80 


12.70 


8.14 


10.00 


6.84 


6.54 


6.16 




Posttest Mean 


50.88** 


60.63 


56.33** 


57.94** 


58.39** 


54.45** 


73.02** 




Posttest Standard Deviation 


4.09 


6.69 


9.27 


9.91 


6.96 


6.08 


5.46 




Number of Cases 


49 


46 


49 


49 


49 


49 


49 




Number with Pretest High 


15 


a 


9 


5 


3 


8 


0 




Number with Posttest High 


27 


25 


35 


39 


45 


38 


48 




Per Cent Showing Gain 


559^ 


52% 


7V% 


8098 


9298 


7898 


9698 


2226 


Pretest Mean 


35.43 


60.89 


37.60 


37.43 


42.52 


41.45 


59.95 




Pretest Standard Deviation 


4.94 


10.22 


7.36 


9.25 


7.41 


7.83 


6.89 




Posttest Mean 


39.24** 


72.94** 


42.95** 


a . 52** 


51.40** 


48.17** 


66.83** 




Posttest Standard Deviation 


6.40 


7.49 


7.22 


9.23 


7.99 


8.47 


6.50 




Number of Casee 


42 


36 


42 


. 42 


42 


42 


42 




Number with nwtest High 


11 


2 


5 


7 


3 


7 


4 




Number with Posttest High 


29 


33 


37 


32 


37 


35 


37 




Per Cent Showing Gain 


699 J 


929 C 


689{ 


7698 


6698 


8398 


6898 


2395 . 


Pretest Mean 


40.61 


68.54 


43.34 


36.34 


47.48 


45.39 


63.59 




^test Standard Deviation 


7.44 


8.96 


7.93 


10.07 


7.70 


6.69 


5.73 




Posttest Mean 


45.18** 


76.93** 


46.91** 


46.09** 


54.20** 


46.25 


67.61** 




Posttest Standard Deviation 


6.13 


6.03 


7.32 


9.25 


8.' i 5 


5.99 


5.62 




Number of Cases 


44 


41 


44 


44 


44 


44 


44 




Nuiber with Pretest High 


9 


3 


13 


4 


4 


19 


6 




Number with Posttest High 


33 


38 


31 


37 


39 


25 


33 




Per Cent Showing Gain 


759 C 


93% 


7098 


8498 


8998 


5798 


7598 


2562 


Pretest Mean 










54.22 


50.89 


69.11 




n?etest Standard Deviation 










5.a 


6.45 


3.93 




Posttest Mean 










55.44 


52.56 


72.67* 




Posttest Standard Deviation 










4.66 


6.50 


4.94 




Number of Cases 










9 


9 


9 




Number with Pretest High 










4 


4 


2 




Number with Poettest High 










5 


4 


7 




Per Cent Showing Gain 










5698 


4498 


7898 


*Given the preteet msah, the probability of this poettest mean occurring by chance is less than or equal to . 


05 . 


^Given the pretest nean» the probability of this poettest mean occurring by chance is less than or equal to . 


01 . 
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Table 2 (Continued) 



fiietitute 

Nunber Item 


listening 

Comporehonsicn 


Speaking 


Reading 


Writing 


Applied Civillirfitien 
lini^stion and Culture 


nrofsesicnal 

Pneparaticn 


2605 


Preteet Mean 


45.83 


72.87 


46.27 


45.83 


48.67 


46.90 


63.83 




Preteet Standard Deviation 


6.64 


10.70 


8.57 


9.25 


5.82 


7.82 


5.95 




Poatteat Mean 


48.30** 


82.13** 


49.27** 


52.13** 


53.80** 


50.43** 


69.77** 




Poatteat Standard Deviation 


5.42 


9.02 


8.66 


8.60 


7.90 


6.79 


4.61 




Nuniber of Caaea 


30 


30 


30 


30 


30 


30 


30 




Muiiber with taeteat High' 


10 


4 


• 10 . 


4 


6 . 


8 


4 




Ntmiber with Poatteat High 


18 


25 


17 


25 


21 


21 


24 




Per Cant Showing Gain 


60!( 


B3% 


57!« 


83% 


70!< 


70% 


809K 


2971 


Preteat Mean 


39.04 


65.83 


44.51 


43.31 


47.79 


45.46 


65.58 




Preteat Standard Deviation 


6.57 


8.96 


8.77 


9.63 


7.57 


6.98 


6.87 




Poatteat Mean 


45.63*» 


78.23** 


46.82** 


49.86** 


54.48** 


52.73** 


69.77** 




Poatteat Standard Deviation 


5.17 


9.04 


8.93 


9.44 


9.55 


6.39 


5.64 




Nunber of Caaee 


49 


47 


49 


49 


48 


48 


48 




Number with Preteat High 


3 


1 


13 


5 


6 


8 


9 




Number with Poatteat High 


46 


46 


30 


42 


41 


40 


37 




Per Cent Shovdng Gain 


%% 


98% 


6liK 


86!{ 


85!« 


83% 


77% 


3390 


Preteet Mean 


48.93 


82.26 


56.23 


56.17 


53.00 


50.87 


67.43 




Preteat Standard Deviation 


6.53 


11.67 


6.59 


8.71 


7.51 


8.23 


6.10 




Poatteat Mean 


52.10*H^ 


87.78** 


59.43** 


62.03** 


60.07** 


57.63** 


71.13** 




Poatteat Standard Deviation 


4.51 


9.02 


10.82 


10.36 


8.26 


7.05 


6.99 




Number of Caaea 


30 


27 


30 


30 


30 


30 


30 




Number with Preteat High 


6 


8 


10 


2 


1 


3 


4 




Nuniber with Poatteat High 


21 


16 


18 


26 


28 


26 


21 




Per Cent Showing Gain 


70i« 


67% 


60% 


m 


93!« 


87i< 


70i< 


3898 


Preteat Mean 


47.28 


70.87 


50.56 


49.52 


49.00 


lt8.2U 


63.88 




Preteat Standard Deviation 


'7.14 


9.34 


7.90 


8.86 


6.69 


7.29 


7.44 




Poatteat Mean 


50.UO** 


79.74** 


53.76** 


54. 88**^ 


58.04** 


49.56 


69.68** 




Poatteat Standard Deviation 


5.37 


10.81 


8.25 


10.33 


7.98 


6.18 


5.54 




Nuniber of Caaea 


25 


23 


25 


25 


25 


25 


25 




Ntmiber vdth Preteat High 


6 


1 


5 


2 


0 


8 


0 




Nvmiber with Poatteat High 


18 


22 


17 


22 


25 


13 


24 




Per Cent Showing Gain 


72% 


96% 


68% 


88^ 


lOOjK 


52!« 


96i« 


3901 


ft^teat Mean 


45.80 


78.48 


48.82 


48.70 


48.48 


47.18 


63.27 




Preteat Standard Deviation 


5.20 


8.76 


7.13 


6.78 


6.01 


5.69 


6.12 




Poatteat Mean 


48.34^«^ 


78.14 


51.91** 


53.25** 


53.82** 


51.18** 


70.55** 




Poatteat Standard Deviation 


4.14 


6.76 


7.03 


6.88 


6.57 


5.58 


4.57 




Number of Caaea 


44 


42 


44 


44 


44 


44 


44 




Number with Preteat High 


9 


23 


13 


6 


8 


7 


4 




Niunber with Poatteat High 


29 


15 


28 


34 


34 


32 


37 




Per Cent Showing Gain 


66% 


36% 


6k% 


77% 


77% 


73% 


8U% 


3916 


Preteat Mean 


43.84 


72.96 


45.80 


44.04 


46.50 


43.36 


59.30 




ft*eteat Standard Deviation 


7.28 


10.87 


8.05 


9.41 


6.32 


6.97 


6.73 




Poatteat Mean 


48.58<Hf 


78.56<w 


51.16*1^ 


51.04** 


53.50** 


49.34** 


. 68,22** 




Poatteat Standard Deviation 


6.39 


8.60 


8.55 


9.08 


8.10 


5.51 


5.51 




Nuniber of Caaea 


50 


50 


50 


50 


50 


50 


50 




Nuniber with Preteat High 


4 


11 


6 


3 


8 


7 


1 




Ntmiber with Poatteat High 


40 


37 


43 


46 


42 


41 


49 




Per Cent Showing Gain 


80( 


7k% 


66% 


92!{ 


8U% 


82S^ 


98* 


4389 


Preteat Mean 


39.00 


64.17 


41.38 


37.96 


44.96 


41.54 


63.62 




Preteat Stcmdard Deviation 


7.46 


12.96 


8.97 


11.35 


7.03 


7.11 


6.08 




Poatteat Mean 


44.20** 


76.91*^^ 


44.96** 


45.06** 


52.20** 


49.16** 


67.20** 




Poatteat Standard Deviation 


6.29 


11.46 


8.87 


10.13 


8.66 


6.19 


5.87 




Nuniber of Caaea 


50 


47 


50 


50 


50 


50 


50 




Nuniber with Preteat High 


4 


2 


11 


4 


6 


4 


10 




Nuniber with Poatteat High 


45 


45 


35 


44 


43 


44 


37 




Per Cent Showing Gain 


90% 


96% 


70i« 


88% 


66% 


88^ 


74* 



Given the preteat mean, the probability of thia poatteat mean occurring by chance la leaa than or equal to .05 . 
Given the preteat mean, the probability of thla poatteat mean occurring by chance la leaa than or eq^l to .01 . 
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Table 2 (Continued) 



Institute 


Idstenlng 








Applied 


Civilisation 


Professional 


Nunber 


Item 


Comprehension 


Speaking 


Reading 


Mrlting 


Unguisties and Culture 


Preparation 


5(0.0 


n«test Mean 


34.92 


61.29 


37.70 


36.70 


42.74 


40.10 


58.60 




Pretest Standard Deviation 


5.« 


11.05 


7.01 


8.48 


7.17 


8.06 


8.14 




Posttest Mean 


40.34** 


72.69«* 


a.34** 


42.88** 


52.32** 


47.08** 


67.74** 




Posttest Standard Deviation 


6.95 


8.82 


7.04 


8.56 


8.60 


7.29 


7.86 




Nunfcer of Cases 


50 


48 


50 


50 


50 


50 


50 




HuDber with Pretest High 


6 


2 


12 


2 


1 


5 


2 


t 


Number with Posttest High 


41 


45 


37 


46 


49 


45 


47 




Per Cent Showing Gain 


6S3t 


9k% 


7k% 


9258 


9858 


9058 


9458 


5110 


Rretest Mean 


31.04 


48.47 


30.77 


24.30 


36.11 


33.15 


49.66 




Pretest Standard Deviation 


4.61 


10.53 


5.14 


6.84 


6.63 


6.22 


8.44 




Postteat Mean 


31.55 


59.43** 


36.11** 


33.02** 


42.17** 


36.81** 


55.23** 




Posttest Standard Deviation 


5.92 


10.52 


5.58 


8.a 


7.74 


7.y* 


8.68 




Number of Cases 


WJ 


30 


47 


47 


47 


47 


47 




Nunber trith Pretest High 


20 


2 


4 


0 


6 


10 


6 




Nunber with Posttest High 


22 


27 


41 


46 


39 


34 


40 




Per Cent Showing Gain 


kT% 


905« 


8758 


9858 


8358 


7258 


8558 


5887 


Pretest Mean 


35.43 


62.79 


37.16 


34.61 


42.06 


40.27 


59.29 




Pretest Standard Deviation 


5.54 


9.89 


6.96 


8.58 


7.43 


6.85 


6.02 




Posttest Mean 


39.29** 


67.67** 


42.20** 


41.71** 


48.88** 


50.06W 


68.37** 




Posttest Standard Deviation 


5.85 


7.15 


6.69 


8.51 


7.13 


6.27 


5.29 




Number of Cases 


49 


39 


49 


' 49 


49 


49 


49 




Nunber with Pretest High 


6 


10 


5 


5 


8 


1 


2 




Number with Posttest High 


41 


29 


42 


44 


41 


48 


47 




Per Cent Showing Gain 


SU% 


74S( 


8658 


9058 


8458 


9858 


9658 


5904 


Pretest Mean 


41.28 


67.39 


44.31 


43.a 


48.97 


45.24 


68.10 




Pretest Standard Deviation 


9.00 


10.85 


10.09 


12.04 


8.31 


8.91 


6.18 




Posttest Mean 


U5.90** 


77.79** 


47.93** 


50.28«* 


54.14** 


51.17** 


70.45* 




Posttest Standard Deviation 


5.98 


7.92 


9.73 


11.99 


9.48 


7.a 


6.71 




Number of Cases 


29 


28 


29 


29 


29 


29 


29 




Number with Pretest High 


7 


4 


8 . 


0 


6 


6 


8 




Number with Posttest High 


18 


24 


20- 


28 


23 


23 


21 




Per Cent Showing Gain 


62% 


86^ 


6958 


9758 


7958 


7958 


7258 


6875 


Pretest Mean 


43.95 


71.11 


44.90 


45.17 


48.60 


45.13 


59.25 




Ihwtest Standard Deviation 


7.01 


10.83 


7.84 


8.07 


5.83 


7.21 


6.75 




Posttest Mean 


45.57* 


77.65*<*- 


50.07** 


50.50** 


56.57** 


50.65^<* 


67.47^'* 




Posttest Standard Deviation 


4.19 


7.49 


7.86 


7.65 


6.84 


6.41 


5.16 




Number of Cases 


40 


37 


40 


40 


40 


40 


40 




Number with Pretest High 


13 


9 


5 


5 


1 


7 


4 




Number with Posttest High 


25 


28 


31 


35 


36 


30 


35 




Per Cent Showing Gain 


63% 


. 76% 


7758 


8858 


9058 


7558 


8858 


Total 


Pretest Mean 


40.48 


68.20 


43.08 


41.25 


45.99 


43.64 


61.78 




Pretest Standard Deviation 


8.30 


13.03 


9.84 


11.85 


8.13 


8.42 


7.99 




Posttest^ean 


44,33Wf 


75.58** 


46.98** 


W?.6l** 


52.82** 


48.87** 


68.06** 




Posttest Standard Deviation 


- 7.73 


10.33 


9.72 


11.44 


9.00. 


7.91 


7.;37. 




Number of Cases 


766 


694 


767 


767 


773 


773 


773 




Number with Pretest High 


151 


133 


161 


68 


93 


137 


79 




Number with Posttest High 


559 


543 


562 


669 


658 


596 


665 




Per Cent Showing Gain 


73% 


7«% 


7358 


8758 


8558 


7758 


8^ 



^Given the pretest mean, the probability of this posttest mean occurring by chance is less than or equal to .05 . 
Given the pretest mean, the probability of this posttest mean occurring by chance is less than or equal to .01 . 












Tibia 3 

MU PoNlfa UnfOBfi nrefielaiieir Taaba In OBDUII 
Huns and Standard Dafiatlcna far Pra- and Poattaata and Par Cant ShcMinf (kdn 



Uatltuta 


Uatanlng 








AHliad 


CivUliatien 


Pbofeaaional 


Nuabar 


Item 


Ccnprehanaion 


Spaaklng 


Reading 


Mbiting 


Idnguiatloa and Culture 


preparation 


2562 


nrateat Moan 




' 






59.20 


59.60 


65.80 




nrateat Standard. Darlatlcn 










8.89 


10.89 


7.33 




Poattoat Mean 










63.80 


64.60 


68.40 




Poatteat Standard Devlatlan 










7.44 


5.82 


3.93 




Nuniber of Caaea 










i 


5 


5 




Number with Proteat High 










1 


1 


2 




Nuabar with Poattaat lOgh 










4 


4 


3 




Far Cant Showing Gain 










80 % 


80% 


6X% 


2672 


PVateat Mean 


50.33 


U1.U 


61.02 


61.24 


52.76 


55.79 


61.21 




Preteat Standard Deviation 


6.45 


15.35 


5.84 


8.19 


6.61 


8.59 


6.87 




Poatteat Mean 


52.60«*» 


113.66* 


61.52 


68.19#* 


56.48#* 


61.02#* 


63.55*# 




Poatteat Standard Deviation 


4.00 


18.10 


6.20 


8.26 


7.66 


8.58 


6.79 




Number of Caaea 


42 


35 


42 


42 


42 


42 


42 




Number with nrateat High 


13 


10 


16 


2 


9 


9 


11 




Nuaber with Poatteat High 


25 


22 


22 


3® 


31 


31 


28 




Per Cent Showing Gain 


60f 


63K 


52% 


90!J 


76% 


76% 


675* 


2929 


Preteat Mean 


43.65 


93.07 


49.95 


50.97 


49.07 


49.07 


61.60 




Proteat Standard Deviation 


8.82 


13.47 


8.86 


10.32 


7.58 


8.45 


7.50 




Poatteat Moan 


44.67 


92.15 


52.27«» 


55.67#* 


53.10#* 


54.07#* 


69.10#* 




Poatteat Standard Deviation 


8.00 


12.02 


8.16 


11.52 


8.89 


8.72 


6.59 




Number of Caaea 


40 


27 


40 


40 


40 


40 


40 




Nubber with Rreteat High 


13 


17 


12 


5 


7 


9 


4 




Nunber with Poatteat High 


20 


10 


26 


33 ^ 


27 


2L 


36 




Per Cent Showing Gain 


50f 


375« 


65% 


82J^ 


67% 


72% 


90JJ 


*4488 


Rreteat Moan 


33.88 


79.86 


40.93 


37.44 


44.08 


46.14 


59.88 




nreteat Standard Deviation 


8.13 


16.97 


9.08 


12.41 


7.37 


9.19 


6.93 




Poatteat Mean 


39.20*» 


83.88** 


42.56* 


44.44** 


51.86#* 


50.93** 


65.39*# 




Poatteat Standard Deviation 


8.98 


13.21 


10.15 


U.73 


8.34 


7.95 


6.17 




Nunber of Caeea 


59 


58 


59 


59 


59 


59 


59 




Number with Areteat High 


12 


20 


20 


5 


2 


12 


6 




Nuaber with Poatteat High 


46 


36 




52 


55^ 


44 


SL 




Per Cent Showing Gain 


78U 


62% 


61% 


86 % 


93 % 


75J< 


80% 


4859 


Preteat Heaii 


45.05 


94.U 


55.46 


52.88 


50.61 


53.32 


56.22 




Preteat Standard Deviation 


8.74 


16.92 


8.97 


9.08 


7.84 


8.32 


7.22 




Poatteat Mean 


50.90«* 


96.84«' 


56.46 


63.39#* 


61.24## 


59.46** 


69.90## 




Poatteat Standard Deviation 


5.53 


14.97 


8.35 


10.13 


8.18 


7.78 


5.83 




Nunber of Caaee 


a 


38 


a 


a 


a 


41 


a 




Nunber with Rreteat High 


5 


14 


14 


0 


0 


6 


1 




Nunber with Poatteat High 


32 


23 


24 


40 


40 ' 


33 






Per Cent Showing Gain 


78J« 


61% 


59J< 


98 % 


98 % 


80% 


98 % 


Total 


Freteat Mean 


42.34 


92.47 


50.82 


49.38 


48.94 


50.87 


59.90 




Rreteat Standard Deviation 


10.26 


19.85 


11.43 


13.76 


8.31 


9.66 


7.46 




Poatteat Mean 


46.13#* 


95.01** 


52.20#* 


56.66#* 


55.54*# 


56.11*# 


66.84*# 




Poatteat Standard Davlatlon 


9.03 


18.44 


U.26 


14.22 


9.10 


9.28 


6.77 




Nunber of Caeee 


182 


158 


182 


182 


187 


187 


187 




Number with Preteat High 


43 


61 


62 


12 


19 


37 


24 




Nunber with Poatteat High 


123 


91 


108 


163 


157 


141 


154 




Per Cent Showing Gain 


68!C 


58X 


591* 


90% 


8k% 


75% 


82% 



^Glven the pretaat maan« the preibabill^ of thla poatteat mean occurring by chance la laaa than or equal to .05 . 



^Glven the preteat mean* the probability of thla poatteat mean occurring by chance la leaa than or equal to .01 . 
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Table 4 

HLA PoMiip XiinguBt* nraflcienoj Teats In ITAlIiUI 
Hauls and Standard Dsalaticns for Rrs- and Pesttsst and Fbr Cant Shoiilng Gain 



£fistitute 


listening 








Applied 


CivlUsaticn 


Rrofessiorial 


Nia»«r 


It«a 


Coaqprehsnsion 


Speaking 


Reading 


Writing 


Idngvdetics and Culture 


Preparation 


2765 


Pretest Mean 


38.44 


82.85 


39.U 


48.05 


46.62 


46.51 


54.28 




Pretest Standard Deviation 


5.55 


15.56 


7.84 


9.29 


7.19 


5.55 


6.a 




Posttest Hean 


37.69 


98.tt** 


44.13#* 


50.00* 


52.28** 


52.74** 


65.51** 




Posttest Standard Deviation 


5.80 


9.38 


8.71 


10.10 


7.40 


6.33 


6.32 




Nunber of Cases 


39 


39 


39 


39 


39 


39 


39 




Nuniber with Pretest Hi^. 


20 


1 


7 


11 


2 


4 


0 




Nunber with Posttost High 


13 


36 


32 


26 


35 


34 


39 




Per Cant Shoeing Gain 


33< 


923C 


829C 


673^ 


90% 


en 


lOOK 


3898 


Rretest Hean 


42.12 


94.24 


47.96 


57.36 


50.40 


52.08 


61.20 




Pretest Standard Deviation 


5.13 


14.33 


11.32 


14.21 


8.89 


9.65 


7.63 




Postteet Mean 


42.16 


100.44«<^ 


52.04** 


58.52 




55.96** 


64.08* 




Posttest Standard Deviation 


6.14 


13.19 


9.27 


13.74 


8.71 


8.90 


7.06 




Husber of Cases 


25 


25 


25 


25 


25 


25 


25 




Nunber with Pretest High 


9 


4 


6 


12 


3 


4 


8 




Nunber with Posttest High 


12 


20 


18 


11 


20 


20 


16 




Per Cent Showing Gain 


48K 


809( 


72% 


IM% 


80% 


80% 


643C 


Total 


Pretest Mean 


39.88 


87.30 


42.75 


51.69 


48.09 


48.69 


56.98 




Pretest Standard Deviation 


5.68 


16.08 


10.24 


12.34 


8.11 


7.91 


7.59 




Posttest Mean 


39.44 


99.20»Hf 


47.22** 


53.33* 


53.09** 


54.00** 


64.95** 




Posttest Standard Dovlation 


6.32 


11.07 


9.73 


12.38 


8.00 


7.60 


6.65 




Nunber of Cases 


64 


64 


64 


64 


64 


64 


64 




Nunber with Pretest Hic^ 


29 


5 


13 


23 


5 


8 


8 




Nunber with Posttest High 


25 


56 


50 


37 


55 


54 


55 




Per Cent Showing Gain 


395< 


88;e 


78% 


58S< 


863t 


8U% 


88% 









Thbla 5 














MLA Foreiffi Language Proficiency Tests in RUSSIAN 










Means and Standard Deviations for Pre- and Posttest and Per Cent Showing Gain 






Institute 


listening 








Applied 


Civilisation 


Professional 


Nunber 


Item 


Comprehension 


Speaking 


Reading 


Writing 


Linguistics and Culture 


Preparation 


1324 


Pretest Mean 


46.62 


93.19 


36.97 


61.86 










Pretest Standard Deviation 


6.27 


11.63 


9.14 


U.61 










Posttest Hean 


46.21 


94.74 


42.28** 


66.93** 










Posttest Standard Deviation 


3.92 


7.27 


10.13 


12.30 










Nunber of Cases 


29 


27 


29 


29 










Nunber with Pretest High 


13 


13 


5 


4 










Nunber with Posttest High 


14 


14 


22 


23 










Per Cent Showing Gain 


48!( 


52% 


76% 


79% 








3351 


nretest Mean 


41.08 


83.42 


34.96 


53.17 


46.29 


46.94 


61.31 




Pretest Standard Deviation 


6.72 


10.14 


9.11 


13.06 


4.79 


7.64 


7.33 




Posttest Kean 


43.19** 


91.42** 


39.40** 


60.56** 


50.56** 


54.50** 


64.33** 




Posttest Standard Deviation 


4.48 


8.80 


10.31 


11.39 


6.59 


6.68 


6.82 




Nunber of Casee 


48 


40 


48 


48 


48 


48 


48 




Nunber with Rretest High 


16 


2 


10 


4 


8 


3 


14 




Nunber with Posttest High 


30^ 


38 


38 


44 


34 


41 


30 




Per Cent Showing Gain 


(&% 


95% 


79J8 


92% 


7138 


8538 


6338 


Total 


nntest Moan 


43.17 


87.36 


35.71 


56.44 


46.29 


46.94 


61.31 




nretest Standard Deviation 


7.08 


11.78 


9.17 


13.22 


4.79 


7.64 


7.33 




Posttest Hean 




92.76** 


40.48** 


62.96** 


50.56** 


54.50** 


64.33** 




Posttest Standard Deviation 


4.52 


8.38 


10.34 


12.14 


6.59 


6.68 


6.82 




Nunber of Cases 


77 


67 


77 


77 


48 


48 


48 




Nunber with Pretest High 


29 


15 


15 


8 


8 


3 


14 




Nunber with Postteet High 


44 


52 


60 


67 


34 


41 


30 




Per Cent Showing Gain 


57% 


78% 


78% 


873« 


7138 


8538 


6338 



Oivsn the pretest otean, the probability of this poatteet nean occurring by chance is less than or equal to .05 . 

4Hf 

Given the pretest mean, the probability of this poatteet mean occurring by chance is leas than or equal to .01 . 
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HLA Poiwifi lufoit* npofleitney Tasts in SPAHIR! 

MMns and Standard Oavlations for and Posttaat and Par Cant Skowlnc Gain 



. Znatituta 

Nuribar Itam 


liotanlng 

Cooqbrahanaion 


Speaking 


Reading 


Writing 


Applied ClviUaation . 
Idn^otica and Culture 


nrofeaeional 

Preparation 


0968 


n^taat Haan 


40.32 


60.U 


39.63 


44.76 


43.53 


47.87 


61.89 




ftataat Standard Deviation 


6.61 


13.75 


8.32 


11.29 


6.U1 


9.00 


6.46 




Poatteat Mean 


44.37a# 


74.86** 


43.05** 


49.13** 


48.66** 


55.08** 


67.62** 




Poatteat Standard Deviation 


6.60 


10.77 


9.10 


13.22 


8.38 


8.52 


6.44 




Number of Caaea 


38 


35 


38 


38 


38 


38 


38 




Nuodber with Prateat High 


7 


2 


9 


6 


6 


3 


3 




Number with Poatteat High 


28 


33 


28 


30 


32 


34 


33 




Par Cant Showing Gain 


lk% 


%% 


743< 


79% 


8k% 


8958 


8758 


1324 


Preteat Mean 


51.17 


78.31 


56.97 


ea.orr 


55.13 


64.13 


69.53 




ftvtaet Standard Deviation 


3.45 


11.53 


5.75 


6.17 


7.69 


7.27 


5.49 




Poatteat Mean 


52.73* 


84.08** 


58.30* 


73.13** 


59.27** 


68.53** 


72.23** 




Poattaet Standard Deviation 


4.72 


7.81 


6.00 


7.65 


7.08 


8.06 


7.23 




Number of Caeea 


30 


26 


30 


30 


30 


30 


30 




Nuober with nreteet High 


9 


7 


9 


4 


8 


6 


5 




Number with Poettaat High 


20 


18 


18 


26 


20 


24 


24 




Par Cent Showing Gain 


67Jt 


699( 


(OH 




67% 


8058 


8058 


1372 


Prateat Mean 


38.43 


56.91 


39.39 


44.34 


43.66 


49.70 


61.11 




Aretaet Standard Deviation 


7.17 


11.11 


7.25 


10.55 


6.52 


7.30 


6.66 




Poatteat Mean 


43.59** 


74.40** 


43.59** 


46.64** 


51.07** 


56.34** 


67.80** 




Poettaat Standard Deviation 


6.59 


10.53 


8.23 


11.19 


7.19 


7.80 


5.97 




Number of Caaea 


44 


43 


44 


44 


44 


44 


44 




Number with Pretaet High 


4 


0 


11 


12 


1 


2 


3 




Number with Poettaat High 


38 


43 


27 


25 


41 


39 


39 




Par Cent Showing Gain 


86J( 


loot 


fas 


57% 


93J( 




8958 


1494 


Preteat Haan 


35.29 


53.51 


36.92 


39.56 


a. 75 


47.94 


59.68 




hvtaat Standard Deviation 


5.88 


U.79 


6.97 


9.80 


6.44 


8.11 


6.36 




Poatteat Mean 


40.52** 


70.95** 


40.88** 


45.58** 


49.42** 


50.88** 


66.0k*» 




Poatteat Standard Deviation 


6.40 


13.44 


7.38 


10.35 


6.61 


9.38 


5.60 




Number of Caaea 


48 


43 


48 


48 


48 


48 


48 




Number with Prateat Hi^ 


3 


3 


10 


4 


3 


16 


5 




Number with Poettaat High 


43 


40 


36 


43 


43 


31 


43 




Par Cant Showing Gain 


90!« 


93S« 


Ti% 


90i« 


90SJ 


6558 


9058 


1834 


Areteat Haan 


36.42 


50.40 


37.48 


42.20 


42.58 


48.98 


59.70 




Prataat Standard Davlation 


5.71 


10.73 


6.42 


10.10 


5.28 


6.57 


6.71 




Poatteat Haan 


42.08*« 


70.78** 


41.32** 


45.36*# 


52.00** 


50.98** 


66.44** 




Poettaat Standard Davlation 


5.42 


11.29 


5.63 


10.38 


6.79 


6.85 


7.40 




Numbar of Caaaa 


50 


50 


50 


50 


50 


50 


50 




Numbar with Prateat High 


6 


0 


7 


14 


2 


17 


9 




Numbar with Poatteat High 


43 


50 


39 


32 


47 


29 


40 




'Par Cant Showing Gatin 


869( 


100!( 


IfS 


6lS 


9458 


5858 


8058 


^^70 


Prataat Haan 


38.45 


56.70 


41.30 


48.52 


44.57 


50.15 


61.72 




Prataat Standard Davlation 


6.07 


10.77 


7.76 


10.16 


7.51 


7.04 


7.23 




Poettaat Haan 


43.30** 


76.85** 


UU.2(m 


55.67** 


51.02** 


54.35** 


68.07*i» 




Poettaat Standard Davlation 


5.78 


8.64 


7.08 


12.08 


7.07 


7.53 


5.85 




Number of Caaea 


40 


40 


40 


40 


40 


40 


40 




Numbar with Prateat High 


4 


2 


8 


6 


5 


9 


5 




Numbar with Poatteat High 


3 L 


38^ 


30 


34 


33 


31 


35 




Par Cent Showing Gain 


90JJ 


953< 


75% 


85% 


8258 


7758 





Given the preteat mean, the probability of thia poatteat mean oceurxlng by chance ia leaa than or equal to .05 . 
Given the prateat mean, the probability of thia poatteat mean occurring by chance ia leaa than or equal to .01 . 
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Tibl« 6 (ConbimNd) 



•« 



Snatltute 

Ntoiber Iten 


Ilatoning 

Conprehanaian 


Speaking 


Raadlng 


Writing 


AppU*d OivUlaation 
Idnguiatioa and Culture 


Pbofessicnal 

Rraparation 


2295 


FMteat Kean 


42.55 


56.14 


45.61 


51.96 


43.10 


52.73 


64.16 




nretaat Standard Daviatlan 


7.05 


10.81 


8.90 


9.51 


6.70 


8.98 


6.99 




Poattaat Kean 


47.00«* 


63.17** 


48.37** 


57.63** 


51.61** 


56.53** 


68.68** 




Poatteat Standard Deviation 


6.65 


8.99 


8.12 


12.34 


7.04 


9.00 


6.04 




NudMr of Casas 


49 


42 


49 


49 


49 


49 


49 




NuBbar with Fbetest Ugh 


6 


0 


14 


9 


2 


16 


6 




Nuaber with Poattaat Ugh 




42 


30 


38 


47 


32 


39 




Par Cant Showing Gain 


849( 


1009C 


618 


788 


968 


658 


808 


2605 


nretaat Moan 


43.27 


57.17 


45.43 


51.07 


46.73 


53.30 


62.67 




FNtaat Standard Daviatlan 


7.61 


U.51 


9.39 


12.07 


8.29 


9.06 


7.46 




Poattaat Kean 


46.03*» 


77.67** 


49.63** 


57.47** 


53.90** 


59.43** 


69.00** 




Poattaat Standard Daviatlan 


6.23 


10.77 


8.06 


15.06 


8.15 


9.26 


6.67 




Nuabar of Casas 


30 


30 


30 


30 


30 


30 


30 




Nuabar with Prataat Ugh 


7 


0 


6 


6 


2 


6 


2 




Nuabar with Poatteat Ugh 


21 


30 


23 


21 


27 


23 


26 




Per Cent Showing Gain 


70t 


1008 


778 


708 


908 


778 


878 


3390 


Rreteat Kean 


45.67 


65.58 


49.37 


55.77 


47.13 


57.47 


66.60 




Pretest Standard Dsvlatlon 


5.49 


10.69 


6.05 


8.73 


6.46 


7.73 


5.32 




Poattaat Haan 


49.27»» 


65.23** 


52.90** 


65.93** 


52.33** 


61.90** 


69.63** 




Poatteat Standard Daviatlan 


6.06 


9.36 


6.61 


10.79 


6.62 


6.94 


5.52 




Nuabar of Casas 


30 


26 


30 


30 


30 


30 


30 




Nusber with Awtast Ugh 


3 


0 


5 


2 


2 


7 


7 




Nuabar with Poattaat Ugh 


26 


26 


23 


26 


25 


21 


20 




Per Cant Showing Gain 


B7% 


1008 


778 


938 


638 


708 


678 


4492 


Rreteat Haan 






36.04 


38.96 


36.36 


45.27 


57.33 




Pretest Standard Deviation 






10.59 


13.71 


5.68 


6.61 


6.75 




Poatteat Kean 






42.19** 


44.85** 


43.19** 


54.61** 


66.46** 




Poatteat Standard Dsvlatlon 






9.11 


16.23 


7.32 


7.29 


5.74 




Nuabar of Cases 






47 


46 


46 


46 


46 




Nuidber with Rreteat Ugh 






11 


6 


7 


4 


1 




Nunbsr with Poatteat Ugh 






34 


40 


40 


43 


45 




Per Cent Showing Gain 






728 


638 


638 


908 


948 


4852 


Pretest Ksan 


45.79 


68.30 


46.03 


54.49 


47.50 


55.29 


64.92 




Pretest Standard Deviation 


5.78 


11.66 


7.92 


10.46 


6.29 


6.74 


6.15 




Poatteat Haan 


49.10** 


83.96** 


50.93** 


61.13** 


54.39** 


61.07** 


70.24** 




Poatteat Standard Deviation 


5.79 


9.42 


7.23 


11.07 


7.15 


7.62 


6.12 ' 




Nunber of Cases 


72 


69 


72 


72 


72 


72 


72 




Nuabar with Pretest Ugh 


13 


6 


17 


7 


7 


11 


9 




Nuber with Poatteat Ugh 


56 


62 


51 


61 


63 


57 


61 




Per Cent Showing Gain 


78X 


908 


718 


858 


668 


798 


658 


5222 


Rreteat Kean 


36.66 


53.97 


41.32 


46.00 


42.50 


50.27 


60.36 




Rreteat Standard Dsvlatlon 


6.22 


n.ei 


6.10 


11.29 


5.39 


6.54 


6.60 




Poatteat Haan 


43.27** 


73.28** 


45.20** 


50.45** 


49.65** 


55.55** 


68.50** 




Poatteat Standard Deviation 


5.76 


9.55 


8.39 


12.39 


6.63 


6.12 


6.01 




Nusber of Caees 


40 


39 


40 


40 


40 


40 


40 




Nunber with ^test Ugh 


2 


0 


5 


6 


3 


6 


3 




Nunber with Poatteat Ugh 


35 


38 


34 


32 


37 


33 


36 




Per Cent Showing Gain 


eef 


978 


858 


608 


928 


628 


908 



Given the preteet aeen« 
Given the in>eteet oieany 



the probability of thla poettest mean occurring by chance le lesa than or equal to .05 • 
the probability of this postteat naan occurring by c'nance la lesa than or equal to .01 . 



Tabl« 6 (Ocnblnuid) 



Instituts 


listening 








AppUed 


Civilisation 


Professional 


Nobtr 


It«l 


0 

1 
1 


Spaaking 


Itsading 


Writing 


linguistlea and Culture 


Preparation 


5816 


Mstest Mean 


43.95 


53.14 


45.90 


54.49 


45;14 


52.93 


60.37 




Pretest Standard Oaviation 


7.31 


12.81 


9.45 


12.35 


8.11 


8.26 


6.79 




Poatteat Kean 


47.86WO 


79.91«* 


49.10«» 


58.92** 


50.98** 


56.42** 


65.20** 




Postteat Standard Deviation 


6.79 


11.60 


8.02 


14.22 


8.40 


.. 9.78 


7.04 




NinDer of Casee 


59 


57 


59 


59 


59 


59 


59 




Nunber with Protest High 


6 


1 


13 


15 


6 


U 


9 




Ntoiwr with Poetteet High 


52 


56 


44 


43 


48 


43 


47 




Per Cent Showing Gain 


88X 


989C 


15% 


733J 


SIX 


733J 


80% 


5904 


Protest Mean 


39.63 


47.76 


42.17 


47.77 


45.33 


U8.ll 


64.57 




nroteot Standard Deviation 


7.81 


13.87 


9.93 


11.92 


6.59 


10.59 


6.31 




Poetteet Kean 


44.60iHf 


72.66«H» 


46.87** 


54.83** 


51.03** 


51.43** 


70.30** 




Posttest Standard Deviation 


7.35 


11.59 


9.15 


13.80 


8.10 


9.40 


5.03 




Nuaiber of Casee 


30 


29 


30 


30 


30 


30 


30 




Nuaiber with Pretest High 


3 


0 


3 


1 


7 


5 


4 




Nuaher with Posttest High 


25 


29 


26 


28 


23 


23 


26 




Psr Cent Showing Gain 




1009^ 


87% 


933J 


n% 


775J 


87% 


6101 


Pretest Mean 


32.54 


46.02 


33.78 


34.54 


39.09 


44.11 


58.15 




Pretest Standard Deviation 


3.79 


9.59 


4.92 


6.24 


4.92 


6.86 


5.54 




Posttest Mean 


37.48«* 


67.63** 


39.07** 


38.52** 


49.02** 


54.17** 


66.50** 




Posttest Standard Deviation 


5.48 


10.38 


5.69 


7.65 


7.30 


7.57 


6.15 




Nuaher of Cases 


46 


46 


46 


46 


46 


46 


46 




Nunber with Pretest IQ.gh 


8 


0 


3 


6 


2 


2 


5 




Nuaber with Posttest High 


36 


46 


39 


35 


44 


44 


41 




Per Cent Showing Gain 


78!J 


ioq{ 


85% 


765« 


•9fS% 


96J< 


89 


Total 


Pretest Mean 


40.75 


57.05 


42.50 


47.80 


44.12 


50.93 


61.94 




Pretest Standard Deviation 


7.55 


13.28 


9.37 


12.52 


7.28 


9.03 


7.03 




Posttest Mean 


45.04*» 


76.75** 


46.11** 


53.19** 


51.03** 


56.30** 


68.01** 




Posttest Standard Deviation 


7.10 


U.87 


8.73 


14.36 


7.84 


8.81 


6.40 




Nuaber of Cases 


606 


575 


653 


654 


654 


654 


654 




Nuaber with Prstest High 


81 


21 


131 


106 


63 


la 


78 




Nunber with Posttest High 


500 


551 


482 


516 


570 


507 


555 




Per Cent Showing Gain 


839( 


969( 


743J 


19% 


87% 


18% 


855* 



Given the preteet aeen« the probability of thla poetteet naan occurring by chance is lese than or equal to .05 . 
Given the pretest nean, the probability of this posttest nean occurring by chance is less than or equal to .d . 






TAU 7 

MLA Poralff) Lm [ hii» i » Rrofleltnop Tiitt In PIti Innguigtt 
Total Group Homo and Standard Oarlatlona for FTa- and Poattoata 
and Far Cant of Total Group Shoidng Galna 







Uatenlng 








Applied 


ClviUaatlon 


ftvfeaalonal 


language 


Itam Conprohenalon 


Speaking 


Reading 


Writing 


llngulatlca and Culture 


Areparatlon 


French 


ftmtoot Mean 


40.48 


68.20 


43.08 


a.25 


45.99 


43.64 


61.78 


Total 


ftmtoat Standard Deviation 


8.30 


13.03 


9.84 


U.85 


8.13 


8.42 


7.99 




Poatteat Mean 


44.33a* 


75.58** 


46.98** 


47.61** 


52.82** 


48.87** 


68.06** 




Poatteat Standard Deviation 


7.73 


10.33 


9.72 


U.44 


9.00 


7.91 


7.37 




Difference Boteeen Meana 


3.85 


7.38 


3.90 


6.36 


6.83 


5.23 


6.28 




Difference / nreteat SD 


0.46 


0.57 


0.40 


0.54 


0.84 


0.62 


0.79 




Nundser of Caeee 


766 


694 


767 


767 


773 


773 


773 




Per Cent Showing Gain 


13 % 


78!J 


13 % 


8738 


8538 


7788 


8638 


German 


ftmteat Mean 


42.34 


92.47 


50.82 


49.38 


48.94 


50.87 


59.90 


Total 


Rreteat Standard Deviation 


10.26 


19.85 


11.43 


13.76 


8.31 


9.66 


7.46 




Poatteat Mean 


46.13** 


95.01** 


52.20** 


56.66** 


55.54** 


56.U** 


66.84** 




Poatteat Standard Deviation 


9.03 


18.44 


U.26 


14.22 


9.10 


9.28 


6.77 




Difference Between MOane 


3.79 


2.54 


1.38 


7.28 


6.60 


5.24 


6.94 




Difference / nretoat SD 


0.37 


0.13 


0.12 


0.53 


0.79 


0.54 


0.93 




Muniber of Caaea 


182 


158 


182 


182 


187 


187 


187 




Per Cent Showing Gain 


68K 


58!« 


593c 


9038 


84 ^ 


7538 


8238 


Italian 


Preteat Mean 


39.88 


87.30 


42.75 


51.69 


48.09 


48.69 


56.98 


Total 


Preteat Standard Deviation 


5.68 


16.08 


10.24 


12.34 


8.U 


7.91 


7.59 




Poatteat Maan 


39.44 


99.20** 


47.22** 


53.33* 


53.09** 


54.00)1* 


64.95** 




Poatteat Standard Deviation 


6.32 


U.07 


9.73 


12.38 


8.00 


7.60 


6.65 




Difference Between Meana 


- 0.44 


U.90 


4.47 


1.64 


5.00 


5.31 


7.97 




Difference / ftmtoat Mean 


- 0.08 


0.74 


0.44 


0.13 


0.62 


0.67 


. 1.05 




Muniber of Caaea 


64 


64 


64 


64 


64 ^ 


64 


64 




Per Cent Showing Gain 


39JC 


88 % 


18 % 


5838 


8638 


8438 


8638 


Suaalan 


Preteat Mean 


43.17 


87.36 


35.71 


56.44 


46.29 


46.94 


61.31 


Total 


Preteat Standard Deviation 


7.08 


U.78 


9.17 


13.22 


4.79 


7.64 


7.33 




Poatteat Mean 


44.32» 


92.76** 


40.48** 


62.96** 


50.56** 


54.50** 


64.33** 




Poatteat Standard Deviation 


4.52 


8.38 


10.34 


12.14 


6.59 


6.68 


6.82 




Difference Between Meana 


1.15 


5.40 


4.77 


6.52 


4.27 


7.56 


3.02 




Difference / ftmteat SD 


0.16 


0.46 


0.52 


0.49 


0.89 


0.99 


o.a 




Muniber of Caaea 


77 


67 


77 


77 


48 


48 


48 




Par Cent Showing Gain 


57!< 


18 % 


18 % 


8738 


7138 


8538 


6338 


Spanlah 


Rreteat Mean 


40.75 


57.05 


42.50 


47.80 


44.12 


50.93 


61.94 


Total 


Rreteat Standard Deviation 


7.55 


13.28 


9.37 


12.52 


7.28 


9.03 


7.03 




Poatteat Mean 


45.04** 


76.75** 


46.U** 


53.19** 


51. 03** 


56 . 30 iHt 


68.01** 




Poatteat Standard Deviation 


7.10 


U.87 


8.73 


14.36 


7.84 


8.81 


6.40 




Difference Between Meana 


4.29 


19.70 


3.61 


5.39 


6.91 


5.37 


6.07 




Dlffaimnca / ftmtaat SD 


0.57 


1.48 


0.39 


0.43 


0.95 


0.59 


0.86 




Muniber of Caaea 


606 


575 


653 


654 


654 


654 


654 




Per Cent Showing Gain 


839t 


96 % 


743J 


7938 


8738 


7838 


8538 


Total: 


nwteat Mean 














61.44 


All 


Pretaat Standard Deviation 












7.67 


languagea Postteat Moan 














67.69** 




Poatteat Standard Deviation 












7.00 




Difference Between Meana 














6.25 




Difference / ftmteat SD 














0.81 




Muniber of Caaea 














1726 




Par Cant Showing Gain 














8538 



Glvon the pretaat meant tho probability of this poatteat mean occurring by chance la leaa than or equal to .05 • 






Given the preteat mean* the probability of thla poatteat maan occurring by chance la leaa than or equal to .01 . 



er|c 



